Method, apparatus, and program for image processing on image data that have already been subjected to image processing

ABSTRACT

Image processing reflecting image processing that was carried out on image data is carried out on the image data. Image data sets S 1  obtained by a digital camera  1  have been subjected to image processing and image processing information G representing the type of image processing is added to the image data sets S 1 . In an image output apparatus  2 , setting means  24  sets the content of image processing to be carried out on the image data sets S 1  according to the image processing information G added thereto. For example, if the image processing information G indicates tone processing, the image processing is set so as not to carry out tone processing. Output image processing means  22  carries out the image processing on the image data sets S 1  according to the content, and print output means  25  prints processed image data sets S 2  as prints P.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing method and an imageprocessing apparatus for carrying out image processing on image datathat have already been subjected to image processing carried out by adigital camera or the like and added with image processing informationregarding the image processing by the digital camera or the like. Thepresent invention also relates to a program embodied on acomputer-readable recording medium to cause a computer to execute theimage processing method.

2. Description of the Related Art

In a digital still camera (hereinafter referred to as a digital camera),an image obtained by photography can be recorded as digital image datain a recording medium such as an internal memory or an IC card, and canbe reproduced by a printer or a monitor based on the digital image data.In the case where an image obtained by a digital camera is reproduced,the image is expected to have as high a quality as a print generatedfrom a negative film.

When a print is generated in the above manner, the quality of the printcan be improved by carrying out thereon image processing such as densityconversion processing, white balance processing, gradation conversionprocessing, saturation enhancement processing, and sharpness processing.Therefore, a method has been proposed (U.S. Pat. No. 6,011,547), inorder to obtain high-quality printed matter. In this method, photographyinformation such as information on use of flash and the type of lightingis added to image data obtained by a digital camera, and moreappropriate image processing can be carried out on the image data withreference to the photography information added to the image data.

Meanwhile, a digital camera has also been proposed that enables outputof photographed image data having been subjected to automatic or manualimage processing. In such a digital camera having an image processingfunction, image processing is carried out so as to attain an optimalimage quality according to a photographed scene and a photographycondition. Furthermore, a photographer can select the type of imageprocessing to be carried out on the image data and various functionsrelated to the image processing according to his/her intention. Forexample, automatic white balance processing, white balance processing ina fixed light source mode, processing for image quality modification(regarding tones, sharpness, and chroma) and a preference regardingreproduced image (such as preference for a monochrome image, asepia-color image, and a beautiful skin color) can be selected as thetype of image processing. As the various kinds of functions regardingimage processing are included selection of a photography mode (such asportrait mode, scenery/distant view mode, macro/close-up mode, nightview/fireworks mode, underwater photography mode, and user exposurecorrection mode), an automatic bracket function, photography using anoptical filter, soft focus photography, interval photography, serialphotography, multiple exposure, superposition with a template, andsuperposition with a frame. Optimal image processing can be carried out,reflecting an intention of the photographer according to the selectedtype of image processing and function.

In the case where image data obtained by such a digital camera having animage processing function are reproduced by a reproduction apparatussuch as a printer or a monitor, further image processing is carried outon the image data. However, if the image processing is further carriedout on the image data that have already been subjected to the imageprocessing by the digital camera, a reproduced image may not have thequality intended for by the digital camera or the reproductionapparatus.

Meanwhile, automatic white balance processing by a digital camera refersto processing that causes white balance of an image photographed inartificial lighting to look like white balance of an image photographedin daylight. More specifically, the automatic white balance processingis to correct image data so as to cause an average of the image data(that may exclude high saturation pixels) to become a gray value havingan intended color temperature (such as color temperature of daylight ortungsten light). For this reason, when automatic white balanceprocessing is carried out, an image photographed in a light sourcehaving a low color temperature such as a tungsten light can bereproduced to have more preferable or natural colors. If a sunset isphotographed in a fixed daylight mode among fixed light source modes ofa digital camera, image data processed by the automatic white balancefunction enables reproduction of an image reflecting a reddish color ofthe sunset.

On the other hand, in a reproduction apparatus, white balance processingis carried out for absorbing a characteristic of white balance of adigital camera. Therefore, images obtained from a reproduction apparatushave almost the same white balance, since the reproduction apparatuscannot distinguish between automatic white balance processing set in adigital camera and image processing in a fixed light source mode.

SUMMARY OF THE INVENTION

The present invention has been conceived based on consideration of theabove circumstances. An object of the present invention is therefore tocarry out image processing on image data in consideration of imageprocessing that has already been carried out by a digital camera or thelike having a function of image processing.

An image processing method of the present invention is an imageprocessing method for obtaining processed image data by carrying outimage processing on image data added with image processing informationregarding image processing that has been carried out on the image data,implemented by:

Setting the content of the image processing to be carried out on theimage data based on the image processing information.

The “image processing information on image processing that has beencarried out” refers to information representing the content of the imageprocessing that has been carried out on the image data or informationfrom which the content of the image processing that has been carried outon the image data can be inferred. As the information representing thecontent of image processing is used information representing the type ofimage processing such as automatic white balance processing, whitebalance processing according to a light source, gradation conversionprocessing, density conversion processing, color correction processing,sharpness processing, monochrome processing, and sepia-color processing.The information enabling inference of the content of the imageprocessing refers to information from which how the image processing wascarried out can be inferred, although the information does not directlyspecify the type of the image processing. As such information can beused a photography mode set in a digital camera (such as portrait mode,scenery/distant view mode, macro/close-up mode, night view/fireworksmode, marine photograph mode, and user exposure correction mode), anautomatic bracket function, photography using an optical filter, softfocus photography, interval photography, serial photography, multipleexposure, superposition with a template, and superposition with a frame.A flag prohibiting or diminishing further image processing may be usedas the image processing information.

The image data have the format defined by JEIDA (Japan ElectronicIndustry Development Association). The format, Exif (Exchangeable imagefile format), allows description of various kinds of information in taginformation thereof. Therefore, by describing the image processinginformation in the tag information, the image processing information canbe added to the image data.

In the image processing method of the present invention, the content ofthe image processing to be carried out on the image data may be setbased on a result of analysis of the image data, in addition to theimage processing information.

The “result of analysis of the image data” refers to the content of theimage processing that was carried out on the image data, and can beobtained by judging which type of the image processing was carried outon the image data, based on colors, tones, density, and sharpness of theimage data, for example.

The image processing method of the present invention may furthercomprise the step of:

judging whether or not predetermined image processing is carried out orwhether or not the predetermined image processing is to be diminished,based on the image processing information. In this case,

the step of setting the content is the step of canceling or diminishingthe predetermined image processing in the case where the predeterminedimage processing is judged to be not carried out or to be diminished.

The “predetermined image processing” refers to a specific type ofprocessing from among a plurality of types of the image processing, ifthe plurality of types of the image processing is carried out on theimage data. The specific type of image processing may represent all thetypes of the image processing. In the case where only one of the typesof the image processing is carried out on the image data, the one typeof the image processing refers to the predetermined image processing.

“Canceling the predetermined image processing” refers to not carryingout the predetermined image processing.

In the image processing method of the present invention, it ispreferable for the image processing information to be output togetherwith the processed image data.

An image processing apparatus of the present invention comprisesprocessing means for obtaining processed image data by carrying outimage processing on image data added with image processing informationregarding image processing that has already been carried out on theimage data. In the image processing apparatus of the present invention,the processing means sets the content of the image processing to becarried out on the image data, based on the image processinginformation.

In the image processing apparatus of the present invention, theprocessing means may set the content of the image processing based on aresult of analysis of the image data in addition to the image processinginformation.

The image processing apparatus of the present invention may furthercomprise:

judgment means for judging whether or not predetermined image processingis carried out or whether or not the predetermined image processing isto be diminished, based on the image processing information. Thejudgment means may cancel or diminish the predetermined imageprocessing, in the case where the predetermined image processing isjudged to be not carried out or to be diminished.

The image processing apparatus of the present invention may furthercomprise output means for outputting the image processing informationtogether with the processed image data.

The image processing method of the present invention may be provided asa program that causes a computer to execute the image processing method.

According to the present invention, the content of the image processingto be carried out on the image data is set based on the image processinginformation added to the image data. Therefore, the content of the imageprocessing to be carried out on the image data can be set so as not toinfluence the image processing that has already been carried out.Consequently, by carrying out the image processing according to thecontent that has been set, processed image data reflecting the imageprocessing that has already been carried out can be obtained.

By setting the content of the image processing according to the resultof analysis of the image data, the content of the image processing thathas been carried out can be known with certainty. Therefore, theprocessed image data can securely reflect the image processing that hasalready been carried out on the image data.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a configuration of an image outputsystem adopting an image output apparatus of a first embodiment of thepresent invention;

FIG. 2 is a block diagram showing procedures carried out by output imageprocessing means;

FIG. 3 is a flow chart showing the operation in the first embodiment;

FIG. 4 is a block diagram showing a configuration of an image outputsystem adopting an image output apparatus of a second embodiment of thepresent invention;

FIG. 5 is a flow chart showing the operation in the second embodiment;

FIG. 6 shows a manual processing input window (part 1); and

FIG. 7 shows the manual processing input window (part 2).

DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, embodiments of the present invention will be explained withreference to the accompanying drawings. FIG. 1 is a block diagramshowing a configuration of an image output system adopting an imageoutput apparatus of a first embodiment of the present invention. Asshown in FIG. 1, the image output system in the first embodimentcomprises a digital camera 1 and an image output apparatus 2. The imageoutput apparatus 2 outputs as a print or prints P (hereinafter referredto as the prints P) an image data set or image data sets S1 (hereinafterreferred to as the image data sets S1) obtained by the digital camera 1.

The digital camera 1 comprises imaging means 11 including a lens, ashutter, and CCDs, DSC image processing means 12 for obtaining the imagedata sets S1 by carrying out image processing on an image data set orimage data sets S0 (hereinafter referred to as the image data sets S0)obtained by the imaging means 11, recording means 13 for recording theimage data sets S1 in a memory card 14, and input means 15 comprising aselection dial and a setting button for variously setting the DSC imageprocessing means 12.

A photographer can set the type of image processing to be carried out onthe image data sets S0 obtained by photography, with use of the inputmeans 15. As the image processing can be listed automatic white balanceprocessing, white balance processing according to a light source,gradation conversion processing, density conversion processing, colorcorrection processing, sharpness processing, monochrome processing, andsepia-color processing. Photography modes such as portrait mode,scenery/distant view mode, macro/close-up mode, night view/fireworksmode, underwater photography mode, and user exposure correction mode arealso available. The user exposure correction mode is the mode for a userto manually correct an exposure condition. Other settings such as anautomatic bracket function, photography with an optical filter, softfocus photography, interval photography, serial photography, multipleexposure, superposition with a template, and superposition with a framecan also be used.

The DSC image processing means 12 obtains the image data sets S1 bycarrying out the image processing on the image data sets S0 according tothe type of the image processing set by the photographer. In the casewhere one of the photography modes has been set, the DSC imageprocessing means carries out the image processing on the image data setsS0 according to the photography mode that has been set, and obtains theimage data sets S1. The image data sets S1 are of Exif format, and imageprocessing information G representing the type of image processing thathas been carried out on the image data sets S1, the photography mode,and the like is described in tag information added to each of the imagedata sets S1.

The recording means 13 records the image data sets S1 added with theimage processing information G in the memory card 14.

In the digital camera 1 having the above components, the image data setsS0 are obtained by photography with the imaging means 11, and the DSCimage processing means 12 carries out the image processing on the imagedata sets S1 according to the type of the image processing or thephotography mode input from the input means 15. In this manner, theimage data sets S1 are obtained, and the image processing information Gdescribing the type of the image processing and the photography mode isadded to the image data sets S1. The recording means 13 records theimage data sets S1 added with the image processing information G in thememory card 14.

The image output apparatus 2 comprises reading means 21 such as a cardslot for reading the image data sets S1 from the memory card 14, outputimage processing means 22 for obtaining a processed image data set orprocessed image data sets S2 (hereinafter referred to as the processedimage data sets S2) by carrying out image processing on the image datasets S1, judgment means 23 for judging the type of the image processingthat has been carried out on the image data sets S1 from the imageprocessing information G, setting means 24 for setting the content ofimage processing to be carried out on the image data sets S1 by theoutput image processing means 22 according to the type of the imageprocessing judged by the judgment means 23, and print output means 25for outputting the processed image data sets S2 as the prints P.

FIG. 2 is a block diagram showing procedures carried out in the outputimage processing means 22. As shown in FIG. 2, the output imageprocessing means 22 reduces the image data sets S1, calculates an imageprocessing condition J based on the reduced image data sets, and carriesout density correction processing, white balance processing, gradationconversion processing (that is, tone processing), color correctionprocessing, enlargement processing for adjusting an image size, andsharpness processing, according to the image processing condition J. Inthis manner, processed image data sets S2 are obtained. The content ofthe processing carried out by the output image processing means 22 isset by the setting means 24.

The operation of the image output apparatus 2 will be explained next.FIG. 3 is a flow chart showing the operation of the image outputapparatus 2. The reading means 21 reads the image data sets S1 from thememory card 14 (Step S1), and the image processing information G addedto the image data sets S1 is input to the judgment means 23. The type ofthe image processing that has been carried out on the image data sets S1is then judged by the judgment means 23 according to the imageprocessing information G (Step S2). The setting means 24 sets thecontent of the image processing to be carried out on the image data setsS1, based on the type of the image processing (Step S3).

Hereinafter, how to set the content of the image processing according tothe type of the past image processing will be explained in detail. Inthe case where the image processing information G includes informationon automatic white balance processing and white balance processing forthe case of a fixed light source such as daylight or tungsten light,white balance processing by the output image processing means 22 is setto be cancelled or diminished.

In the case where the image processing information G does not includethe information on the white balance processing, automatic white balanceprocessing is set to be carried out. For example, an average of pixelvalues excluding high-saturation pixels is calculated from an imagerepresented by any one of the image data sets S1, and a conversion tablefor conversion of the average into a predetermined reference value isgenerated for conversion of the image data sets S1. In this case, theconversion table is preferably generated based on more than one of theimage data sets S1.

In the case where the image processing information G includesinformation on gradation conversion processing, gradation conversionprocessing is not carried out by the output image processing means 22.Alternatively, the gradation conversion processing may be carried outaccording to a standard gradation conversion curve for image output instandard tones.

Meanwhile, in the case where the image processing information G does notinclude the information on gradation conversion processing, thegradation conversion processing is carried out by the output imageprocessing means 22 in accordance with a dynamic range of the image datasets S1. For example, for the image data sets S1 whose dynamic range iswide, tones are softened by decreasing data values in an intermediatedensity range and in a shadow range. In this manner, colors in theshadow range are prevented from being flattened. On the contrary, forthe image data sets S1 whose dynamic range is small, the image data setsas a whole and/or in a highlight range are increased to have hard tones.

In the case where the image processing information G includesinformation on saturation enhancement processing, saturation enhancementprocessing by the output image processing means 22 is cancelled. Sincechroma is enhanced by hard tones, gradation conversion processing toharden tones is cancelled or diminished.

In the case where the image processing information G includesinformation on sharpness processing, the sharpness processing by theoutput image processing means 22 is cancelled or diminished. In somecases, a degree of sharpness is changed in accordance with acharacteristic of the print output means 25 or a condition to view areproduced image. Therefore, such sharpness processing for compensatingthe sharpness change is carried out even if the image processinginformation G represents the fact that the sharpness processing hasalready been carried out in the digital camera 1.

In the case where the image processing information G includesinformation on a photography mode, the type of image processing carriedout in the photography mode is inferred, and the inferred imageprocessing is cancelled or diminished. For example, if the imageprocessing information G includes information on scenery/distant viewmode, the image data sets S1 have already been subjected to processingfor softening tones in a low frequency range, gradation conversionprocessing, sharpness processing, and saturation enhancement processing.Therefore, the processing of these types is cancelled or diminished.

In some cases, automatic bracket photography is carried out by using thedigital camera 1. Automatic bracket photography is to photograph aplurality of images representing the same subject while changing animage processing condition in a plurality of steps for image processingregarding exposure, chroma, contrast, or sharpness. In this case, theimage processing information G describes for which item (that is, forexposure, chroma, contrast, or sharpness) the bracket photography hasbeen carried out. By carrying out such automatic bracket photography,the plurality of images of various exposure, chroma, contrast, orsharpness can be obtained, and one of the images having desiredexposure, chroma, contrast, or sharpness can be selected therefrom. Inthis case, in order to reflect in the image data sets S1 the change ofthe image processing condition in the automatic bracket photographycarried out by the digital camera 1, image processing by the outputimage processing means 22 is not carried out on the image data sets S1obtained by the automatic bracket photography. Alternatively, for theitems of image processing other than the item of image processing whoseimage processing condition was changed in the automatic bracketphotography, the output image processing means 22 carries out the imageprocessing by using the same image processing conditions.

If the image processing by the image output apparatus 2 is carried outon the image data sets S1 obtained by automatic bracket photography, thechange in exposure, chroma, contrast, or sharpness in the automaticbracket photography cannot be reflected in the processed image data setsS2. Therefore, in the case where the image processing information Gincludes information on the automatic bracket photography, the settingmeans 24 cancels the image processing by the output image processingmeans 22 or sets the image processing to be carried out according to apredetermined image processing condition for the item of imageprocessing whose image processing condition was changed in the automaticbracket photography. More preferably, for the items of image processingother than the item of image processing whose image processing conditionwas changed in the automatic bracket photography, the setting means setsthe output image processing means 22 to carry out the image processingby using the same image processing conditions on all the image data setsS1. In this manner, the processed image data sets S2 reflecting theeffect of automatic bracket photography can be obtained.

In the case where the image processing information G includesinformation on monochrome processing or sepia-color processing, thewhite balance processing is set to be not carried out or to bediminished.

In the case where the image processing information G includesinformation on soft focus photography, sharpness processing is set to benot carried out or to be diminished.

In the case where the image processing information G includesinformation on interval photography, an average of an image processingparameter found from each of the image data sets S1 is used in the imageprocessing by the output image processing means 22, in order to carryout the same image processing on all the image data sets S1 obtained bythe interval photography. Alternatively, the image processing is set tobe carried out according to the same image processing parameter as theimage processing parameter used for the image data set S1 that issubjected to the image processing first among all the image data setsS1.

In the case where the image processing information G includesinformation on superposition with a template, density conversionprocessing, white balance processing, gradation conversion processing,and color correction processing are set to be cancelled or to bediminished so as not to change colors and density of the template.

As shown in Table 1 below, the content of image processing on the imagedata sets S1 may be set according to the type of the image processing orthe photography mode represented by the image processing information G.In Table 1, a circle represents cancellation or diminishing of thecorresponding image processing. An X refers to usage of thepredetermined condition or usage of the same image processing conditionon the image data sets obtained by serial photography, multipleexposure, and super position with a frame.

TABLE 1 Density Gradation Image Processing Color Chroma/Hue ConversionConversion Sharpness Information Processing Processing ProcessingProcessing Processing Fixed Light ◯ ◯ Source Mode Gradation ◯ conversionProcessing Sharpness ◯ Processing Saturation ◯ ◯ enhancement ProcessingPortrait Mode ◯ ◯ ◯ Scenery/Distant ◯ ◯ view Mode Macro/Close-up ◯ ModeNight ◯ ◯ View/Fireworks Mode Underwater ◯ ◯ Photography Mode UserExposure ◯ Correction *Automatic ◯ ◯ ◯ ◯ Bracket Photography Serial X ◯Photography Multiple Exposure X Superposition X with Frame *Select acircle, depending on the content of automatic bracket photography

After the content of the image processing by the output image processingmeans has been set in the above manner, the output image processingmeans 22 carries out the image processing on the image data sets S1, andthe processed image data sets S2 are obtained (Step S4). The processedimage data sets S2 are printed by the print output means 25 as theprints P (Step S5) to end the procedures.

It is preferable for the image processing information G to be printed onthe backside of each of the prints P. In this case, the image processinginformation G may be printed as characters or as illustrations that canspecify the content thereof.

As has been described above, in the first embodiment, the content of theimage processing to be carried out on the image data sets S1 is setaccording to the image processing information G added to the image datasets S1. Therefore, the content of the image processing on the imagedata sets S1 can be set so as not to influence the image processing thathas already been carried out on the image data sets S1. Consequently, bycarrying out the image processing on the image data sets S1 according tothe content that has been set, the processed image data sets S2 canreflect the image processing that has already been carried out on theimage data sets S1.

By printing the image processing information G on the backside of theprints P, the photographer can easily recognize the image processingcarried out on the image data sets S1 by the digital camera 1.

In the above embodiment, the processed image data sets S2 may bedisplayed on a monitor. In this case, the image processing information Gis displayed at the side of an image reproduced on the monitor.

A second embodiment of the present invention will be explained next.FIG. 4 is a block diagram showing a configuration of an image outputsystem adopting an image output apparatus of the second embodiment ofthe present invention. In the second embodiment, the same components asin the first embodiment have the same reference numbers, and detailedexplanations thereof will be omitted. Differences between the firstembodiment and the second embodiment are as follows. Firstly, in thesecond embodiment, a monitor 31 for displaying processed image data setsS2 as well as various kinds of information is further used together withinput means 32 comprising a keyboard and a mouse for inputting thevarious kinds of information. In the second embodiment, judgment means23 judges whether or not image processing information G includes a flagpreventing or diminishing image processing on image data sets S1. In thecase where the flag is included, the image processing by output imageprocessing means 22 is cancelled or diminished. At the time settingmeans 24 sets a degree of the image processing in the second embodiment,the degree can be adjusted by a manual input from the input means 32.Furthermore, the judgment means 23 judges the content of imageprocessing that has been carried out on the image data sets S1 byanalyzing the image data sets S1.

The flag is included in the image processing information G by aphotographer using a digital camera 1. The flag is included in the imageprocessing information G together with information on the type of imageprocessing and a photography mode, when the image processing is carriedout on the image data sets S0 by the digital camera 1.

In the second embodiment, the image processing information G includesthe flag in addition to the information on the type of the imageprocessing and the photography mode in the digital camera 1. However,depending on a model of the digital camera 1, the image processinginformation G includes only the flag, and the type of the imageprocessing and the photography mode may not be included therein. Forexample, in the case where monochrome processing, sepia-colorprocessing, photography using an optical filter, or superposition with atemplate is carried out, the type of image processing and thephotography mode are not included in the image processing information G.Other types of image processing and photography mode may be included inthe image processing information G.

For this reason, in the second embodiment, the judgment means 23 judgesthe content of the image processing that has been carried out on theimage data sets S1 through analysis of the image data sets S1, in thecase where the image processing information G includes the flag but thecontent thereof is not known.

The operation of the second embodiment will be explained next. FIG. 5 isa flow chart showing the operation in the second embodiment. Readingmeans 21 reads the image data sets S1 from a memory card 14 (Step S21).The image processing information G added to the image data sets S1 isinput to the judgment means 23, and the judgment means 23 judges whetheror not the flag preventing or diminishing the image processing on theimage data sets S1 is included in the image processing information G(Step S22). In the case where a result at Step S22 is affirmative, thejudgment means 23 further judges the type of image processing that hasalready been carried out on the image data sets S1, based on the imageprocessing information G (Step S23). In this case, the type of imageprocessing can also be judged by analyzing the image data sets S1.

For example, in the case where the digital camera 1 does not include inthe image processing in formation G the content of monochrome processingcarried out on the image data sets S1, the flag is included in the imageprocessing information G but the content thereof is not included. Forthis reason, the judgment means 23 judges the number of channels of theimage data sets S1. In the case where the image data sets S1 representimages having 1 channel, the image data sets S1 are judged to have beensubjected to monochrome processing. In the case where the number ofchannels is 3 but averages of RGB values are the same for entire images,the image data sets are also judged to have been subjected to monochromeprocessing.

In the case where the digital camera 1 does not include the content ofsepia-color processing carried out on the image data sets S1 in theimage processing information G, only the flag representing thesepia-color processing is included in the image processing information Gbut the content thereof is not included. For this reason, the judgmentmeans 23 divides each of the images represented by the image data setsS1 into areas. In the case where the averages of RGB values areapproximately the same in each of the areas, the image data sets S1 arejudged to have been subjected to sepia-color processing.

In the case where the image processing information G does not includethe type of the image processing and the photography mode, the judgmentmeans 23 judges the content of the image processing on the image datasets S1 by using various methods, such as the number of channels, theaverages of RGB values, and the averages in the divided areas describedabove.

Once the type of the image processing has been judged by the judgmentmeans 23 as has been described above, the setting means 24 sets thecontent of the image processing to be carried out on the image data setsS1 according to the type of the image processing that has been carriedout, as in the first embodiment (Step S24). In the case where the resultat Step S22 is negative, the content of the image processing to becarried out on the image data sets S1 is set at Step S24 based on theimage data sets S1.

After the content of the image processing has been determined in theabove manner, the output image processing means 22 carries out the imageprocessing on the image data sets S1 to generate the processed imagedata sets S2 (Step S25). The processed image data sets S2 are displayedon the monitor 31 (Step S26), and manual processing by an operator usingthe input means 32 is received (Step S27).

FIG. 6 shows a manual processing input window displayed on the monitor31. As shown in FIG. 6, in the manual processing input window aredisplayed a processed image 41 represented by one of the processed imagedata sets S2, setting switch buttons 42 for switching from automaticsetting to manual setting and vice versa for the image processing, adensity correction button 43 for correcting density, white balanceadjustment buttons 44 for adjusting white balance, tone correctionbuttons 45 for correcting tones, color correction buttons 46 forcorrecting colors, a sharpness correction button 47 for correctingsharpness, and an OK button 48 for confirming the image processing. OFFbuttons are also included in the density correction button 43, the whitebalance adjustment buttons 44, the tone correction buttons 45, the colorcorrection buttons 46, and the sharpness correction button 47, forcancellation of the corresponding image processing.

The tone correction buttons 45 include an HL button, an MD button, andan SD button representing a highlight range, an intermediate densityrange and a shadow range, respectively. The color correction buttons 46include an L button, a C button, and an H button representing lightness,chroma, and hue, respectively.

In the second embodiment, the output image processing means 22automatically carries out the image processing to generate the processedimage data sets S2. Therefore, as shown in FIG. 6, a color of an“automatic setting” button in the setting switch buttons 42 in themanual processing input window is changed so as to easily show that theautomatic setting has been carried out. The color change is shown as ahatched area in FIG. 6. Furthermore, in the case where white balanceprocessing has not been carried out for example, the OFF button for thewhite balance adjustment button 44 is turned on so as to easily showthat the white balance adjustment has not been carried out. In addition,a color of the white balance adjustment buttons 44 is also changed.

An operator judges whether or not the image processing is to be furthercarried out on the processed image data sets in the manual processinginput window. In the case where the manual processing is necessary, theoperator clicks a “manual setting” button in the setting switch buttons42. In this manner, all the buttons in the window becomes usable, andthe operator carries out manual processing for a desired image qualityby adjusting the degree of the image processing with the buttons.

Whether or not the OK button 48 has been clicked is then judged (StepS28). The input for manual processing is received until a result at StepS28 becomes affirmative. When the result at Step S28 becomesaffirmative, the processed image data sets S2 are output as prints P byprint output means 25 (Step S29) to end the operation.

As has been described above, in the second embodiment, the content ofthe image processing to be carried out on the image data sets S1 can beset according to the image processing information G added to the imagedata sets S1. Therefore, the content can be set so as not to influencethe image processing that has already been carried out on the image datasets S1. Furthermore, by carrying out the image processing according tothe manual input, the image processing can be carried out on the imagedata sets S1 as the operator wishes, and the processed image data setsS2 can reflect a preference of the operator as well as the imageprocessing that has already been carried out on the image data sets S1.

In the first and second embodiments described above, the image outputapparatus 2 carries out the image processing on the image data sets S1that have already been subjected to the image processing by the digitalcamera 1. In the case where the image data sets S1 have been subjectedto image processing by a personal computer or the like and added withthe image processing information G representing the content of the imageprocessing, the content of the image processing to be carried out on theimage data sets S1 may be set according to the image processinginformation G, as in the first and second embodiments described above.

In the first and second embodiments described above, the digital camera1 includes the photography mode in the image processing information G.However, the type of image processing carried out on the image data setsS0 according to the photography mode may be included in the imageprocessing information G, instead of the photography mode.

1. An image processing method, comprising the steps of: receivingpreviously-processed image data and first image processing informationrepresentative of first image processing that was previously carried outon original image data to produce said previously-processed image data,wherein said first image processing information is information fromwhich content of the first image processing that was previously carriedout on the original image data can be inferred; inferring the content ofthe first image processing based on the first image processinginformation; and determining the content of second image processing tobe carried out on the previously-processed image data, based on thecontent of the first image processing inferred from the first imageprocessing information, wherein the first image processing informationcomprises information regarding a photography mode set in a digitalcamera, and wherein the content of the second image processing accountsfor the photography mode while retaining the content of the first imageprocessing, and wherein the step of determining the content of thesecond image processing to be carried out comprises: judging whether ornot a predetermined content of the second image processing is to becarried out or whether or not the predetermined content of the secondimage processing is to be diminished, based on the first imageprocessing information; and canceling or diminishing the predeterminedcontent of the second image processing in the case where thepredetermined content of the second image processing is judged to be notcarried out or to be diminished, respectively.
 2. An image processingmethod as defined in claim 1, wherein the step of determining thecontent of the second image processing to be carried out on thepreviously-processed image data is the step of determining the contentbased on a result of analysis of the previously-processed image data inaddition to the first image processing information.
 3. An imageprocessing method as defined in any of claims 1 and 2, furthercomprising the step of: processing the previously-processed image dataaccording to the content of the second image processing to be carriedout, to produce processed image data.
 4. An image processing method asdefined in claim 3, further comprising the step of outputting the imageprocessing information together with the processed image data.
 5. Animage processing method as defined in claim 1, wherein the content ofthe second image processing to be carried out is determined in thedetermining step so as to not influence the first image processing thathas already been carried out.
 6. An image processing method as definedin claim 1, wherein the first image processing that has been carried outor the second image processing to be carried out corresponds to imageprocessing that influences an appearance of the image.
 7. An imageprocessing method as defined in claim 6, wherein the first imageprocessing that has been carried out or the second image processing tobe carried includes at least one of white balance processing, gradationconversion processing, density conversion processing, color correctionprocessing, sharpness processing, monochrome processing, sepia-colorprocessing, and photography mode processing.
 8. The image processingmethod as defined in claim 1, wherein the first image processing wascarried out on the original image data by the digital camera inaccordance with the photography mode, to produce thepreviously-processed image data.
 9. An image processing apparatuscomprising: receiving means for receiving previously-processed imagedata and first image processing information representative of firstimage processing that was previously carried out on original image datato produce said previously-processed image data, wherein said firstimage processing information is information from which content of thefirst image processing that was previously carried out on the originalimage data can be inferred; inferring means for inferring the content ofthe first image processing based image processing information; anddetermining means for determining the content of second image processingto be carried out on the previously-processed image data, based on thecontent of the first image processing inferred from the first imageprocessing information, wherein the first image processing informationcomprises information regarding a photography mode set in a digitalcamera, and wherein the content of the second image processing accountsfor the photography mode while retaining the content of the first imageprocessing, and wherein the determining means further comprises:judgment means for judging whether or not a predetermined content of thesecond image processing is to be carried out or whether or not thepredetermined content of the second image processing is to bediminished, based on the first image processing information, and whereinthe judgment means cancels or diminishes the predetermined content ofthe second image processing, in the case where the predetermined contentof the second image processing is judged to be not carried out or to bediminished, respectively.
 10. An image processing apparatus as definedin claim 9, wherein the determining means determines the content of thesecond image processing based on a result of analysis of thepreviously-processed image data in addition to the first imageprocessing information.
 11. An image processing apparatus as defined inany of claims 9 and 10, further comprising: processing means forprocessing the previously-processed image data according to the contentof the second image processing to be carried out, to produce processedimage data.
 12. An image processing apparatus as defined in claim 11,further comprising output means for outputting the image processinginformation together with the processed image data.
 13. An imageprocessing apparatus as defined in claim 9, wherein the determiningmeans determines the content of the second image processing to becarried out so as to not influence the first image processing that hasalready been carried out.
 14. An image processing apparatus as definedin claim 9, wherein the first image processing that has been carried outor the second image processing to be carried out corresponds to imageprocessing that influences an appearance of the image.
 15. The imageprocessing apparatus as defined in claim 9, wherein the first imageprocessing was carried out on the original image data by the digitalcamera in accordance with the photography mode, to produce thepreviously-processed image data.
 16. A computer-readable medium on whicha program is recorded, the program causing a computer to execute animage processing method comprising the steps of: receivingpreviously-processed image data and first image processing informationrepresentative of first image processing that was previously carried outon original image data to produce said previously-processed image data,wherein said first image processing information is information fromwhich content of the first image processing that was previously carriedout on the original image data can be inferred; inferring means forinferring the content of the first image processing based on the firstimage processing information; and determining the content of secondimage processing to be carried out on the previously-processed imagedata, based on the content of the first image processing inferred fromthe first image processing information, wherein the first imageprocessing information comprises information regarding a photographymode set in a digital camera, and wherein the content of the secondimage processing accounts for the photography mode while retaining thecontent of the first image processing, and wherein the step ofdetermining the content of the second image processing to be carried outcomprises: judging whether or not a predetermined content of the secondimage processing is to be carried out or whether or not thepredetermined content of the second image processing is to bediminished, based on the first image processing information; andcanceling or diminishing the predetermined content of the second imageprocessing in the case where the predetermined content of the secondimage processing is judged to be not carried out or to be diminished,respectively.
 17. A computer-readable medium as defined in claim 16,wherein the step of determining the content of the second imageprocessing to be carried out on the previously-processed image data isthe step of determining the content based on a result of analysis of thepreviously-processed image data in addition to the first imageprocessing information.
 18. A computer-readable medium as defined in anyone of claims 16 and 17, said program further comprising the step of:processing the previously-processed image data according to be contentof the second processing to be carried out, to produce processed imagedata.
 19. A computer-readable medium as defined in claim 18, the programfurther comprising the step of outputting the image processinginformation together with the processed image data.
 20. Acomputer-readable medium as defined in claim 16, wherein the determiningstep determines the second image processing to be carried out so as tonot influence the first image processing that has already been carriedout.
 21. A computer-readable medium as defined in claim 16, wherein thefirst image processing that has been carried out or the second imageprocessing to be carried out corresponds to image processing thatinfluences an appearance of the image.
 22. The computer-readable mediumas defined in claim 16, wherein the first image processing was carriedout on the original image data by the digital camera in accordance withthe photography mode, to produce the previously-processed image data.